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PURPOSE 


The Office of the Inspector General (OIG) has completed its fourth annual Training Evaluation and 
Management System II (TEAMS II) Audit (Audit), Phase I in accordance with its Annual Audit and 
Review Plan. The purpose of this Audit was to review the quality of investigations, completeness of the 
review process, and appropriateness of the assigned dispositions of threshold-activated action items 
(Action Items). Special Order No. 28, 2008, and Special Order No. 14, 2010, both titled “Duty to 
Conduct and Document Individual Performance Assessments — Revised,” dated August 29, 2008, and 
June 22, 2010, respectively, define the standards for which the Audit was conducted. These Special 
Orders describe how TEAMS II is to be used as a risk management system primarily through the review 
and disposition of Action Items. 


BACKGROUND 


TEAMS II was developed in keeping with the Department’s core value of “Quality Through Continuous 
Improvement” and provides supervisors and managers with the ability to better manage the workplace. 
TEAMS II is made up of several data systems including the Use of Force System, Complaint 
Management System, Deployment Period System, Risk Management Information System (RMIS), and 
others. For example, RMIS, from which Action Items are generated, was developed by the Department in 
an effort to promote professionalism and best policing practices. RMIS extracts data from other 
Department databases compiling the information concisely, thus allowing the data to be easily reviewed 
by supervisors and managers so that they are able to identify “at risk” employees. These Department 
databases contain relevant performance information about all Department employees, including crimes 
and arrests, claims and lawsuits, commendations, collisions, traffic citations, training, vehicle pursuits, 
pedestrian and vehicle stops, complaints, and use of force incidents.’ RMIS, utilizing performance 
information contained within these databases, analyzes employee performance within peer groups (e.g., 
patrol, traffic, detectives) and notifies the appropriate supervisor via an Action Item when an employee’s 
performance is significantly different from others who perform similar work. An Action Item notification 
requires intensive review by various levels of Department management in order to recognize positive 
performance or provide the appropriate corrective action for the affected employee. 


METHODOLOGY AND SCOPE 


Special Order No. 28, 2008, and Special Order No. 14, 2010, were used as the standard for testing the 
Action Items. The OIG’s population, from which random samples were selected for testing, included all 
1,384 Action Items that were generated during the six-month period from August 1, 2010, through 
January 31, 2011. The Audit scope included three objectives with various tests performed to address 
these objectives, as detailed in the following table. Further details for each objective’s methodology and 
sample are provided in the Detailed Methodology section for each objective. 


The OIG conducted this Audit in accordance with generally accepted government auditing standards. 
These standards require that the Audit is adequately planned, performed, and supervised, and that 
sufficient, appropriate evidence is obtained by applying review procedures which assess whether a 
reasonable basis for the findings and conclusion were contained herein. 





' This information is systematically captured by TEAMS II and appears on an employee’s TEAMS II report. 
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SUMMARY OF RESULTS 


Test 1 


Determine if there was a brief summary for each use of force, complaint, claim/lawsuit, 
vehicle pursuit, and traffic collision occurring within the evaluation period. 





83% (35/42) 





Test 2 


Determine if there was analysis of the events as a whole to determine a pattern of conduct. 


100% (42/42) 





Test 3 


Determine if there was a documented comparison of the employee's performance against 
employees in the same peer group, organization or similar job assignment, with an 
explanation for any significant differences between the affected employee's performance 
and that of similar employees. 


93% (39/42) 





Test 4 


Determine if the disposition was adequately explained and justified in the Action Item 
narrative and adequately supported by the information in the Summary of Employee 
Activity and employee’s TEAMS II reports. 


86% (36/42) 





Test 5 











Determine if there was a brief summary of the discussion with the affected employee 
regarding the supervisor's review and disposition selection. 













100% (42/42) 





























Test 1 Determine if the disposition was adequately supported by the Action Item narrative and 50% (13/26) 
supporting TEAMS II reports. 

Test 2 Determine if new corrective action was ordered as a result of the Action Item 62% (16/26) 
investigation. 

Test 3 | Determine if evidence that the new corrective action ordered was actually taken. 100% (16/16) 
Determine if the Training disposition was adequately supported by the Action Item 

Tert narrative and supporting TEAMS II reports. 42% (5/12) 

Test 2 | Determine if new training was ordered as a result of the Action Item investigation. 92% (11/12) 

Test 3 | Determine if evidence that the new training ordered was actually taken. 82% (9/11) 

Test | Determine if Action Items were completed within 60 days of generation. 72% (992/1,384) 











? The OIG determined the corrective action dispositions to be: Training, Special Evaluation Reports, Modified Field Duties, 
Assigned to Non-Field Duties, Risk Management Executive Committee Referral, Directed Behavior Sciences Services 
Referral, Comment Card, Notice to Correct, and Complaint. 


> The OIG identified 26 Action Items with corrective action dispositions. The OIG’s testing determined that for 10 of these 
Action Items, no new action was ordered as a result of the investigation. Hence, only the remaining 16 Action Items could 
be evaluated to determine if the new correction action ordered was actually taken (Objective 2, Category A, Test 3). 


t The OIG identified 38 Action Items with the Training disposition and selected a random sample of 12 Action Items. The 
OIG’s testing determined that the disposition for one Action Item did not represent new action taken as a result of the Action 
Item. Thus, only the remaining 11 Action Items could be evaluated for Objective 2, Category B, Test 3. 
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DETAILED RESULTS 


OBJECTIVE 1 


Determine if Action Items were documented as having been properly completed and reviewed, with the 
disposition justified. 


Background — Objective 1 


The TEAMS II system that conducts performance analysis is RMIS. The RMIS captures data from a 
variety of areas, including an employee’s uses of force, complaints, claims/lawsuits, preventable traffic 
collisions, and vehicle pursuits. The activity in each area is then compared to the employee’s respective 
stops and arrests to determine whether it meets or exceeds statistically calculated peer group performance 
thresholds that have been established.’ Peer groups are comprised of employees who perform similar job 
functions. If an employee’s activity significantly differs from the employee’s peer group average 
performance thresholds, RMIS automatically notifies the employee’s assigned supervisor via an Action 
Item.° Upon receipt of the Action Item, the assigned supervisor is required to review and analyze the 
employee’s TEAMS II reports. 


Special Order No. 28, 2008, and Special Order No. 14, 2010, outline the requirements for completion of 
an Action Item. Additionally, Notice titled “RMIS Action Items — New Investigative Narrative 
Guidelines”, dated February 13, 2009, from the TEAMS I Development Bureau Commanding Officer 
provides the Department guidance in responding to an Action Item. The Notice states the following, “A 
recent audit of Action Items conducted by the Independent Monitor revealed that a number of 
investigative narratives were deficient in providing relevant information to detect at risk behavior. When 
responding to an Action Item, a supervisor must review the employee’s performance as a whole, and not 
just the event triggering the action item. To ensure that the Department meets the requirements, the 
Action Item Report contains the following evaluation prompts to assist supervisors in properly addressing 
the Action Item: 


Provide a brief summary of each use of force within the evaluation period. 

Provide a brief summary of each complaint within the evaluation period. 

Provide a brief summary of each vehicle pursuit and traffic collision within the evaluation period. 
Provide a brief summary of each claim/lawsuit within the evaluation period. 

Compare the employee’s performance against that of similar employees. 

Conduct an analysis of all the events as a whole and determine if there is a ‘pattern of conduct.’ 
Justify the disposition selected. 


Sy ase: Lae 





° The LAPD Manual (Volume V, §15.43.01) defines stops as either motor vehicle stops or pedestrian stops. A motor vehicle 
stop means any instance when an officer directs a person operating a motor vehicle of any type to stop and the driver is 
detained for any length of time. A pedestrian stop means any instance when an officer performs a stop (i.e., a temporary 
detention when a person is not free to leave) of a person who is not in a motor vehicle. 


° “Significantly differs” means > 3.0 standard deviations from the peer group average for most RMIS performance thresholds. 
Standard deviation is a widely used measure of variability used in statistics and probability theory. 
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8. Provide a brief summary of the discussion with the affected employee regarding the supervisor’s 
review and selection of disposition.” 


Detailed Methodology - Objective 1 





The OIG selected a random sample of 42 Action Items from the population of 1,384 Action Items that 
were generated from August 1, 2010, through January 31, 2011.8 Three TEAMS II reports were reviewed 
for each Action Item: (1) Action Item History Report [R46], (2) TEAMS II Report [A00], and (3) 
Summary of Employee Activity Report [A02].’? An Action Item History Report contains the investigative 
narrative and comments of the reviewers. Each Action Item was examined to determine if the supervisors 
and managers had adequately documented their investigation in accordance with Special Order No. 28, 
2008, and Special Order No. 14, 2010. Further, each Action Item History Report was compared to the 
TEAMS II Report and Summary of Employee Activity Report in order to verify the narratives and 
comments included in the Action Item History Report. 


The following five tests were used to review each Action Item: 





Test 1; | Determine for each Action Item if there was a brief summary for each use of force, complaint, 
claim/lawsuit, vehicle pursuit, and traffic collision occurring within the evaluation period. 











Test 2; | Determine for each Action Item if there was an analysis of the events as a whole to determine 
a pattern of conduct. 











Test 3} | Determine for each Action Item if there was a documented comparison of the employee's 
performance against employees in the same peer group, organization or similar job 
assignment, with an explanation for any significant differences between the affected 
employee's performance and that of similar employees. 


Test 4: Determine for each Action Item if the disposition was adequately explained and justified in the 
Action Item narrative, and adequately supported by the information in the Summary of 
Employee Activity and employee’s TEAMS II reports. 


Test 5): Determine for each Action Item if there was a brief summary of the discussion with the 
affected employee regarding the supervisor's review and disposition selection. 





7 A supervisor may choose one or more of the following dispositions: No Action, Further Action Not Required, 
Commendation, Informal Meeting, Training, Special Evaluation Reports, Modified Field Duties, Assigned to Non-Field 
Duties, Risk Management Executive Committee Referral, Directed Behavioral Science Services Referral, Comment Card, 
Notice to Correct, and Complaint. 


oo 


The sample size was calculated using a confidence level of 95%, an expected error rate of 6%, and a plus precision of 6%. 
This sample size calculation formula represents a generally accepted auditing practice. A detailed explanation of each 
parameter is available from the OIG Audit Section. 


Kej 


An Action Item History Report is the documentation of an Action Item investigation that is initially performed by the 
assigned employee’s supervisor and continues up his/her chain of command to the Bureau Commander. 
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Testing Results - Objective 1 


Test 1]: The Department was 83% (35/42) compliant with this test objective. Thirty-five Action Item 
History Reports contained the required summaries. However, seven Action Item History Reports did not 
contain the required event information which was available in the affected employee’s TEAMS II Report. 
Details for these seven exceptions are as follows: 


Action Item No. 555213: The Action Item History Report did not address each of the two complaints 
that this employee received during the evaluation period (CF Nos. 10-000755 and 09-004362). 


Action Item No. 555275: The Action Item History Report did not address the traffic collision that this 
employee was involved in during the evaluation period (DR No. 109922355). 


Action Item No. 555635: The Action Item History Report did not address one of the six complaints 
that this employee received during the evaluation period (CF No. 10-000010). 


Action Item No. 557260: The Action Item History Report did not address one of the two complaints 
that this employee received during the evaluation period (CF No. 10-000235). 


Action Item No. 559039: The Action Item History Report did not address one of the two complaints 
that this employee received during the evaluation period (CF No. 09-004706). 


Action Item No. 564581: The Action Item History Report did not address one of the two complaints 
that this employee received during the evaluation period (CF No. 10-000172). 


Action Item No. 565390: The Action Item History Report did not address two of the three complaints 
that this employee received during the evaluation period (CF Nos. 10-001793 and 10-000663). 





Test 2; The Department was 100% compliant with this test objective. 











Test 3: The Department was 93% (39/42) compliant with this test objective. Thirty-nine of the Action 
Item History Reports included a documented comparison of the employee's performance against 
employees in the same peer group, organization or similar job assignment, with an explanation for any 
significant differences between the affected employee's performance and that of similar employees. 
However, three of the Action Item History Reports did not provide an explanation for significant 
differences between the affected employee’s number of stops and that of similar employees. Details for 
these three exceptions are as follows: 


Action Item No. 556789: The Action Item History Report indicated that this employee's performance 
meets and/or exceeds standards as compared to other employees in his peer group. However, the 
OIG’s review of this employee's TEAMS II Report for the evaluation period indicated that he made 
two stops as compared to other employees in his work group who averaged 247 stops. This low 
number of stops represents a significant difference between the affected employee’s performance and 
that of similar employees but was not addressed in the Action Item History Report narrative. 
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Action Item No. 562282: The Action Item History Report indicated that this employee made 13 stops 
compared to other employees in his squad who averaged 139 stops. This low number of stops 
represents a significant difference between the affected employee’s performance and that of similar 
employees but was not addressed in the Action Item History Report narrative. 


Action Item No. 562329: The Action Item History Report indicated that this employee is on par with 
his peers; however, a review of this employee’s TEAMS II reports for the evaluation period indicated 
that he made two stops as compared to other employees in his Area who averaged 36 stops. This low 
number of stops represents a significant difference between the affected employee’s performance and 
that of similar employees but was not addressed in the Action Item History Report narrative. 


Test 4}: The Department was 86% (36/42) compliant with this test objective. Thirty-six of the Action 
Item History Reports contained adequate justification for the disposition selected. However, six of the 
Action Item History Reports contained dispositions which were inconsistent with the corresponding 
justifications documented by the supervisor in the report. 


Five Action Item History Reports contained a disposition of No Action.'? However, the justification for 
the disposition provided in the Action Item History Reports by the supervisors supported a different 
disposition. Details for these five exceptions, all involving the employee’s low number of stops, are as 
follows: 


Action Item No. 555213 (Disposition — No Action): Based on the Action Item History Report, there 
appears to be a discrepancy between actual number of stops conducted by the employee and the 
reported number of stops. The evaluation narrative concluded that the employee was not inputting the 
required stop information and needed to be counseled by his supervisor to do so in the future.'' Thus, 
the justification provided by the supervisor appeared to support a disposition other than No Action. 


Action Item No. 555701 (Disposition — No Action): The Action Item History Report indicated that a 
discussion was held with the involved employee concerning his stop information that was not being 
entered properly. The evaluation narrative indicated that the supervisor discussed the importance of 
obtaining a Field Data Report (FDR) number for each stop that was initiated. Thus, the justification 
provided by the supervisor appeared to support a disposition other than No Action. 


Action Item No. 562323 (Disposition — No Action): The Action Item History Report indicated that a 
discussion was held with the involved employee concerning the low number of stops he made during 
the evaluation period. The supervisor provided counseling regarding the employee’s low number of 





10 Special Order No. 28, 2008, stipulates for the No Action disposition, “used when the investigation of the Action Item 


11 


reveals no pattern of behavior posing potential risk was identified in the Action Item investigation.” 


The Department Manual (§ 4/202.02 and 5/15.43.01) requires each employee to complete an automated Field Data Report 
for every discretionary stop and for many calls for service resulting in a detention of an individual. Calls for service 
involving violent crimes are exempted. The officer issuing the citation or making the arrest is then required to input the 
stop information into the Automated Field Data Report (AFDR) System (Stop Application). Stop Application information 
is captured in RMIS in the employee’s TEAMS II Summary of Employee Activity Report for the time period specified. 
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stops as compared to his peers. Thus, the justification provided by the supervisor appeared to support 
a disposition other than No Action. 


Action Item No. 556789 (Disposition — No Action): The Action Item History Report indicated that 
the supervisor documented that the employee’s performance was on par with his peers and that his 
overall work history did not present an at-risk pattern. However, the OIG noted that this employee 
made two stops during the evaluation as compared to other employees in his work group who 
averaged 247 stops. The low number of stops warranted further review by his supervisor. 
Furthermore, this employee’s low number of stops was inconsistent with other activity such as arrests 
(57) and citations (119) and should have indicated to the evaluating supervisor that this employee may 
not have been entering his stops, as required. Thus, the evidence appears to support a disposition 
other than No Action. 


Action Item No. 562329 (Disposition — No Action): The Action Item History Report indicated that 
this employee’s activity was on par with his peers; however, a review of his TEAMS II Report 
indicated that he made two stops during the evaluation period as compared to his peers who averaged 
36 stops. Also, this employee made 27 arrests and issued 31 citations during the same evaluation 
period which is inconsistent with the number of stops that he recorded. There was no discussion in 
the report regarding his number of stops as compared to his peers or the apparent inconsistency with 
his number of stops as compared to his arrests and citations. Thus, the justification provided by the 
supervisor appeared to support a disposition other than No Action. 


One Action Item History Report, Action Item No. 555275 (Disposition — Training), indicated that the 
employee was directed to an informal meeting with his supervisor to discuss his low number of stops. It 
was noted that he was directed to receive informal training regarding the importance of completing Field 
Data Reports (stop) information. Special Order No. 28, 2008, describes a disposition of Training as “used 
when the assessment identified a need for formal training.” It further states that “All formal training shall 
be entered into TEAMS I.” It appears that the training received by this employee did not meet the 
definition of formal training and was not entered into his TEAMS II history. Thus, the justification 
provided by the supervisor appeared to support a disposition other than Training. 


| Test 5|: The Department was 100% compliant with this test objective. 
OBJECTIVE 2 


Determine if Action Items with corrective action dispositions were adequately supported and 
represented new action resulting from the Action Item investigation, with the recommended corrective 
action actually taken. 


Background — Objective 2 


Special Order No. 28, 2008, requires supervisors to provide justification for the disposition selected for an 
Action Item. A supervisor may choose one or more of the following dispositions: No Action, 
Commendation, Informal Meeting, Training, Special Evaluation Reports, Modified Field Duties, 
Assigned to Non-Field Duties, Risk Management Executive Committee Referral, Directed Behavioral 
Science Services Referral, Comment Card, Notice to Correct, and Complaint. Special Order No. 14, 
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2010, added the disposition Further Action Not Required. The aforementioned dispositions are defined in 
these Special Orders as follows: 


Further Action Not Required - used when the Action Item investigation determines that some action 
was already taken in connection with the event/incident that triggered the generation of the Action 
Item and no further action is required. 


No Action - used when the investigation of the Action Item reveals no pattern of behavior posing 
potential risk was identified in the Action Item investigation. 


Commendation - used when the investigation of the Action Item reveals the work history of an 
employee is above average and should be commended. 


Informal Meeting - used when the investigation of the Action Item results in a supervisor meeting 
with the employee and conducting an informal counseling [training] session that does not result in any 
further action as a result of the Action Item investigation. 


Training - used when the investigation of the Action Item identifies that the employee should receive 
formal training. All formal training shall be entered into the employee’s TEAMS I history. 


Special Evaluation Reports - used when the investigation of Action Item determines an employee 
needs mentoring. 


Modified Field Duties - used when the investigation of the Action Item identifies a need for 
modification within an employee’s work duties. 


Assigned to Non-Field Duties - used when the Action Item investigation determines an employee 
should be removed from the field and placed in a non-field duty assignment. 


Risk Management Executive Committee (RMEC) Referral - used when the Action Item investigation 
revealed that an employee should be referred to RMEC for special monitoring.” 


Directed Behavioral Science Services (BSS) Referral - used when the Action Item investigation 
revealed that an employee should be referred to BSS for mental health services. 


Comment Card - used when the Action Item investigation requires that a supervisor complete a 
comment card." 





12 The RMEC reviews employee performance to assess liability and also directs non-punitive corrective actions to address 
performance and/or behavior. The RMEC also makes recommendations to the Chief of Police to issue, renew, or rescind 
long or short-term duty restriction letters. These letters restrict an employee to non-field duties with no public contact, 
arrests, or court testimony. 


13 Comment Cards are used to document one of the following: an incident or behavior that was notably good or bad; a 
procedure, policy, or expectation was explained; specific training presented for a particular purpose; or that a particular act 
which was against policy and/or procedure was unacceptable. 
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Notice to Correct (NTC) - used when the Action Item investigation determines that a NTC is 
necessary. 


Complaint - used when the Action Item investigation identifies misconduct and a personnel complaint 
is initiated due to the newly discovered misconduct. 


The OIG evaluated all 13 dispositions specified in Special Order No, 28, 2008, and Special Order No. 14, 
2010, to identify those dispositions that should be deemed corrective action. For a disposition to be 
considered corrective action, the OIG assessed whether the disposition would result in a supervisor taking 
action after an Action Item was finalized. Based on its review, the OIG judgmentally determined the 
following nine dispositions to be corrective action: Training, Special Evaluation Reports, Modified Field 
Duties, Assigned to Non-Field Duties, RMEC Referral, Directed BSS Referral, Comment Card, NTC, and 
Complaint.” 


Detailed Methodology — Objective 2 


The OIG vetted the entire population of 1,384 Action Items that were generated from August 1, 2010, 
through January 31, 2011, to include only those Action Items with corrective action dispositions. The 
population consisted of 64 Action Items. Thirty eight of the Action Items had Training as a disposition 
with the remaining 26 spread among the additional 8 dispositions. The OIG selected a random sample of 
12 of the 38 Action Items with the Training disposition for review. Additionally, the OIG examined all 
26 of the remaining Action Items. The same tests were performed on both samples. Three RMIS reports 
were reviewed for each Action Item: the Action Item History Report (R46), the TEAMS II Report (A00), 
and the Summary of Employee Activity Report (A02).'° Each Action Item History Report contained the 
documented narrative and comments of the reviewers. Each Action Item is typically reviewed by the 
employee’s supervisor, officer in charge, commanding officer, and by the bureau commander. 
Accordingly, the OIG examined each Action Item History Report to determine if the supervisor(s) and 
command staff had adequately documented their review in accordance with Special Order No. 28, 2008. 
Furthermore, each Action Item History Report was compared to the TEAMS II Report and Summary of 
Employee Activity Report to verify the narrative and comments included in the Action Item History 
Report. 





14 A NTC (Notice to Correct Deficiencies, General Form 78) is used to warn or admonish an employee of deficient 
performance or that a particular act was a violation of a rule, policy, procedure, or expectation, and that continuing the 
deficient performance or repeating the particular act (or acts like it) will result in at least a set of particular adverse 
consequences. 


15 Comment Card was considered a corrective action disposition only when combined with another corrective action and not 
when used to commend employee actions. 


16 An Action Item History Report contains the documentation for an Action Item investigation. 
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The following three tests were used to review each sample Action Item: 





Test 1; Determine if the disposition was adequately supported by the Action Item narrative and 
supporting TEAMS II reports. 





Test 2; Determine if new corrective action was ordered as a result of the Action Item investigation. 

















Test 3: Determine if evidence that the new corrective action ordered was actually taken. 








Testing Results — Objective 2 


A. Action Items with Corrective Action Dispositions Excluding Training 











Test 1: The Department was 50% (13/26) compliant with this test objective. A review of 13 Action Item 
History Reports indicated that the corrective action dispositions were adequately supported by the Action 
Item narrative and the employee’s TEAMS II reports. However, the other 13 Action Item History 
Reports did not support the disposition that was assigned by the supervisor. 








Ten of the 13 Action Item History Reports received corrective action dispositions that represented action 
that had been taken prior to the generation of the Action Item. Accordingly, a more appropriate 
disposition for those Action Items would have been Further Action Not Required. Special Order No. 14, 
2010, defines Further Action Not Required as, “used when some action was already taken in connection 
with the event/incident that triggered the generation of the Action Item and no further action is required.” 
Details for these ten exceptions are as follows: 


Action Item No. 566240 (Disposition — Assigned to Non-Field Duties): The Action Item History 
Report indicated that the affected employee had been assigned to non-field duties prior to the 
generation of the Action Item. Thus, the justification provided by the supervisor appeared to support 
a disposition of Further Action Not Required. 


Action Item No. 566352 (Disposition — Assigned to Non-Field Duties): The Action Item History 
Report indicated that the affected employee had already been assigned to non-field duties as a result 
of a previously generated Action Item. Thus, the justification provided by the supervisor appeared to 
support a disposition of Further Action Not Required. 


Action Item No. 556196 (Disposition — Assigned to Non-Field Duties/Further Action Not Required): 
The Action Item History Report indicated that the affected employee had already been assigned to 
non-field duties as a result of a previously generated Action Item. Thus, the justification provided by 
the supervisor appeared to support a sole disposition of Further Action Not Required. 


Action Item No. 561868 (Disposition — Assigned to Non-Field Duties/Directed BSS Referral): The 
Action Item History Report indicated that the affected employee had already been assigned to non- 
field duties and directed to BSS as a result of a previously generated Action Item. Thus, the 
justification provided by the supervisor appeared to support a disposition of Further Action Not 
Required. 
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Action Item No. 566061 (Disposition — Complaint): The Action Item History Report indicated that 
the referencing complaint triggered the generation of the Action Item. Thus, the justification provided 
by the supervisor appeared to support a disposition of Further Action Not Required. 


Action Item No. 563228 (Disposition — Directed BSS Referral): The Action Item History Report 
indicated that the affected employee had already been referred to BSS as a result of a previously 
generated Action Item. Thus, the justification provided by the supervisor appeared to support a 
disposition of Further Action Not Required. 


Action Item No. 566428 (Disposition — Directed BSS Referral/Complaint): The Action Item History 
Report indicated that the affected employee had previously been directed to BSS because of his work 
performance and the referencing complaint triggered the generation of the Action Item. Thus, the 
justification provided by the supervisor appeared to support a disposition of Further Action Not 
Required. 


Action Item No. 561878 (Disposition — Modified Field Duties): The Action Item History Report 
indicated that the affected employee had previously been placed on modified field duties due to a 
previously generated Action Item. Thus, the justification provided by the supervisor appeared to 
support a disposition of Further Action Not Required. 


Action Item No. 556780 (Disposition — Modified Field Duties/Directed BSS Referral): The Action 
Item History Report indicated that the affected employee had already been placed on modified field 
duties and directed to BSS due to complaints that he received prior to the generation of this Action 
Item. Thus, the justification provided by the supervisor appeared to support a disposition of Further 
Action Not Required. 


Action Item No. 558046 (Disposition — Notice to Correct): The Action Item History Report indicated 
that the affected employee was served with the Notice to Correct due to a citizen contact that occurred 
nine months prior to the generation of the Action Item. Thus, the justification provided by the 
supervisor appeared to support a disposition of Further Action Not Required. 


Details of the remaining three exceptions are as follows: 


Action Item No. 558459 (Disposition — Comment Card/Complaint/Assigned to Non-Field Duties): 
The Action Item History Report indicated that the affected employee had been served with the 
referencing Comment Card before the generation of the Action Item and the referencing complaint 
triggered the generation of the Action Item. As a result of the Action Item investigation, this 
employee was assigned to non-field duties. Thus, the justification provided by the supervisor 
appeared to support a sole disposition of Assigned to Non-Field Duties. 


Action Item No. 560025 (Disposition — Special Evaluation Reports/Complaint): The Action Item 
History Report indicated that as a result of the process involved in the review of this Action Item, 
Command Staff recommended that special evaluation reports be completed to monitor this employee. 
The referencing complaint triggered the creation of the Action Item. Thus, the justification provided 
by the supervisor appeared to support a sole disposition of Special Evaluation Reports. 
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Action Item No. 557062 (Disposition — Training/Comment Card): The Action Item History Report 
indicated that the supervisor stated that the affected employee would receive (informal) training 
regarding the requirement to complete stop information. Based on the employee’s low number of 
stops as compared to citations issued and arrests made, the supervisor concluded that this employee 
was not inputting stop information. This employee’s training was not entered into TEAMS II and the 
training appeared to be informal rather than formal. The affected employee received a Comment Card 
documenting the informal training that was provided. Thus, the justification provided by the 
supervisor appeared to support a sole disposition of Comment Card. 


Test 2; The Department was 62% (16/26) compliant with this test objective. Sixteen Action Item History 
Report narratives indicated that new corrective action was ordered as a result of the Action Item 
investigation. Conversely, in the remaining ten Action Item History Reports the corrective action was 
taken prior to the generation of the Action Item. 


All ten exceptions for Test 2 pertain to the same ten Action Items referenced in Test 1: Action Item Nos. 
566240, 566352, 556196, 561868, 566061, 563228, 566428, 561878, 556780, and 558046. 


Test 3: The Department was 100% (16/16) compliant with this test objective, in that there was evidence 
that the new corrective action ordered was actually taken.” 


B. Action Items with Training Disposition 











Test 1; The Department was 42% (5/12) compliant with this test objective. A review of the five 
compliant Action Item History Reports indicated that the corrective action dispositions were adequately 
supported by the employee’s TEAMS II reports and the Action Item narratives. Conversely, the 
remaining seven Action Item History Reports did not support the Training disposition.'* Details for the 
seven exceptions are as follows: 








Action Item No. 557487 (Disposition — Training): The Action Item History Report indicated that 
informal training was provided to the affected employee regarding the proper systematic inputting of 
stop information. According to the Action Item narrative, the affected employee received the training; 
however, the training appeared to be informal and was not reflected on the employee’s TEAMS II 
Report. Thus, based upon the justification provided and that the training was not entered into the 
affected employee’s TEAMS II Report, it appears that another disposition, such as Informal Meeting, 
may have been more appropriate.” 





17 One of the 16 Action Items was No. 566247, with multiple dispositions of Comment Card, Modified Field Duties, and 
Training. The OIG verified that a Comment Card was issued and Modified Field Duties was commenced as a result of the 
Action Item investigation. However, the OIG could not verify that formal training had occurred. Nevertheless, the OIG 
deemed this Action Item compliant with Test 3. 


'S Special Order No. 28, 2008, defines the Training disposition as, “used when the investigation of the Action Item identifies a 
need for formal training and the formal training is entered into the employee’s TEAMS II history.” 


1? Special Order No. 28, 2008, defines the Informal Meeting disposition as, “used when a supervisor meets with the employee 
and conducts an informal counseling [training] session that does not result in any further action.” 
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Action Item No. 558249 (Disposition — Training): The Action Item History Report indicated that 
training was provided to the affected employee by the station training coordinator regarding the 
proper recording of his stop information. According to the Action Item narrative, the affected 
employee received the training; however, the training appeared to be informal rather than formal and 
it was not reflected on his TEAMS I Report. Thus, based upon the justification provided and that the 
training was not entered into the affected employee’s TEAMS II Report, it appears that another 
disposition, such as Informal Meeting, may have been more appropriate. 


Action Item No. 561874 (Disposition — Training): The Action Item History Report indicated that the 
affected employee was counseled by his supervisor regarding the requirement to input stop 
information. Accordingly, the training appeared to be informal and it was not reflected on his 
TEAMS II Report. Thus, based upon the justification provided and that the training was not entered 
into the affected employee’s TEAMS II Report, it appears that another disposition, such as Informal 
Meeting, may have been more appropriate. 


Action Item No. 562503 (Disposition — Training): The Action Item History Report indicated that the 
affected employee issued more citations than he had stops. The supervisor concluded that the affected 
employee was not properly entering his stop information and counseled the employee. Accordingly, 
the training appeared to be informal and it was not reflected on his TEAMS II Report. Thus, based 
upon the justification provided and that the training was not entered into the affected employee’s 
TEAMS II Report, it appears that another disposition, such as Informal Meeting, may have been more 
appropriate. 


Action Item No. 564050 (Disposition — Training): The Action Item History Report indicated that the 
affected employee had more arrests, citations, and investigative reports than his number of recorded 
stops and thus was counseled regarding the requirement to input stop information. Thus, based upon 
the justification provided and that training was not entered into the affected employee’s TEAMS II 
Report, it appears that another disposition, such as Informal Meeting, may have been more 
appropriate. 


Action Item No. 564588 (Disposition — Training): The Action Item History Report indicated that the 
affected employee was counseled by his supervisor for not properly recording his stop information. 
The supervisor subsequently provided training to the affected employee. Thus, based upon the 
justification provided and that the training was not entered into the affected employee’s TEAMS II 
Report, it appears that another disposition, such as Informal Meeting, may have been more 
appropriate. 


Action Item No. 566243 (Disposition — Training): The Action Item History Report indicated that the 
affected employee was counseled by his supervisor for not properly recording his stop information. 
The supervisor subsequently provided training to the affected employee. Thus, based upon the 
justification provided and that the training was not entered into the affected employee’s TEAMS II 
Report, it appears that another disposition, such as Informal Meeting, may have been more 
appropriate. 
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Test 2; The Department was 92% (11/12) compliant with this test objective. Eleven Action Item History 
Report narratives indicated that new training was ordered as a result of the Action Item investigation. 
However, one Action Item History Report (Action Item No. 556194) indicated that training was received 
prior to the generation of the Action Item. 





Test 3; The Department was 82% (9/11) compliant with this test objective. Nine Action Item History 
Report narratives indicated that the new training ordered was actually received. Details for the two 
exceptions are as follows: 











Action Item No. 556639 (Disposition — Training): The Action Item History Report and the 
employee’s TEAMS II report provided no evidence that the training ordered in the corrective action 
disposition took place. The employee’s supervisor reported that formal training was necessary due to 
the employee’s high number of complaints and use of force incidents in relation to his number of 
arrests and stops. 


Action Item No. 566069 (Disposition — Training): The Action Item History Report and the 
employee’s TEAMS II report provided no evidence that the training ordered in the corrective action 
disposition took place. In the Action Item History Report narrative, the employee’s commanding 
officer directed that formal training in the area of tactical communication, search and seizure, and 
laws of arrest be provided to this employee. 


OBJECTIVE 3 


Determine if Action Items were completed timely. 


Background - Objective 3 


Special Order No. 28, 2008, does not require a specific due date for an Action Item investigation, instead, 
RMIS automatically assigns a due date to the Action Item. According to TEAMS II staff, the assigned 
due date is 60 days after the generation of the Action Item. The OIG used the 60-day due date assigned 
by RMIS to test the objective. 


Detailed Methodology — Objective 3 
The OIG performed an aging of the entire population of 1,384 Action Items that were generated during 
the audit scope period. The audit test was to: 





Test: Determine if Action Items were completed within 60 days of generation. 
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Testing Results — Objective 3 


[Test The Department was 72% (992/1,384) compliant with this test objective as 992 Action Items were 
completed within 60 days. The remaining 392 Action Items are aged as follows: 


242 (18%) completed 1 to 30 days late. 
79 (5%) completed 31 to 60 days late. 
40 (3%) completed 61 to 90 days late. 
29 (2%) completed 91 to 172 days late. 
2 (9%) not completed as of July 29, 2011. 


OTHER RELATED MATTER 


Inputting Stop Information 


Background 


The Department requires each employee to complete a Field Data Report for each motor vehicle and 
pedestrian stop, and enter each stop into the Automated Field Data Report System (AFDR).”' The stop 
data is used, in part, for the calculation of two RMIS performance thresholds: (1) number of use of force 
(UOF) incidents compared to the number of stops and (2) number of personnel misconduct complaints 
compared to the number of stops. Failing to record stops creates an inaccurate and artificially low number 
of stops that, when assessed against UOF incidents or personnel complaints, may trigger an Action Item 
unnecessarily. Because each Action Item requires significant resources to investigate, respond and 
review, it is essential that employees properly record each stop. 


Issue 


In total, 7 (17%) of the 42 Action Items reviewed by the OIG under Objective 1 may have been 
unnecessarily generated and reviewed as a result of the employee failing to properly input stop data. In 
most instances, the supervisor recognized that the employee was not properly inputting the data and 
provided informal training. 


PRIOR RECOMMENDATIONS 


The OIG made two recommendations in its previous TEAMS II Audit dated April 26, 2010. The 
recommendations were as follows: 





2 Symbol Qis a mathematical symbol meaning negligible. In this instance, two is only about one tenth of one percent, which 
represents an insignificant percentage of the total number of Action Items not completed within the 60 day requirement. 


*! The Novell-delivered application on the LAPD intranet explains the stops input requirements in officer and supervisor 
tutorials. 
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No. 1 — Department-wide training should be provided regarding the proper assignment of the 
disposition No Action. 


The Department, via TEAMS II Division courses and TEAMS II Coordinator meetings, has provided 
regular training of the relevant Action Item processing protocols established by Special Order No. 28, 
2008, and Special Order No. 14, 2010. Special Order No. 14, 2010, established the disposition of Further 
Action Not Required, to be used if some action was already taken in connection with the same triggering 
event before the Action Item was activated and no further action is required. As such, the Department has 
satisfactorily addressed the recommendation. 


No. 2 - The Department should provide guidance to assist the supervisor in making the 
determination as to whether an employee’s behavior denotes a “pattern” or should be considered 
“at-risk,” and design a system to implement this guidance in the analysis of Action Items. 


The Department, via TEAMS II Division, has begun identifying employees with multiple Action Items 
over a given time period, usually one year. Those employees with the highest number of Action Items are 
individually reviewed through their Action Item History Reports and TEAMS II Reports. These reports 
are reviewed to ensure that each employee’s supervisor is conducting a complete and thorough analysis of 
each Action Item. As such, the Department has satisfactorily addressed the recommendation. 


RECOMMENDATION 


Special Order No. 28, 2008, requires that a supervisor, in response to an Action Item, analyze all relevant 
TEAMS II information to detect any pattern or series of incidents that indicate that an officer may be 
engaging in at-risk behavior. To assist in this requirement, The OIG recommends that TEAMS II 
Division continue identifying employees with disproportionate numbers of Action Items and 
communicate that information to the employee’s commanding officer and Risk Management Group. The 
OIG believes that identifying patterns of at-risk employee behavior is fundamental to the goal of TEAMS 
II and as such, recommends that TEAMS II Division continue this practice on a semi-annual basis. 
Additionally, the OIG recommends that TEAMS II Division retain the work product from each analysis 
for subsequent review by the OIG and/or Internal Audits and Inspections Division. 


MANAGEMENT’S RESPONSE 


On January 11, 2012, the OIG discussed the results of the audit with the Chief Information Officer of 
Information Technology Bureau, who expressed general agreement with the audit. 


CONCLUSION 


The OIG concluded that the Action Items were thoroughly and thoughtfully investigated and as such, 
were of good quality. Action Items were reviewed by supervisors and command staff, thus affording a 
comprehensive review process. However, a significant number of dispositions assigned to the Action 
Items were inconsistent with Department guidelines and may reflect a broad misunderstanding of the 
definitions and proper application of dispositions. This conclusion is supported by the audit tests and 
analysis conducted by the OIG of the Action Items. 
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The OIG noted that a total of 1,384 Action Items were generated during the six-month period selected by 
the OIG for testing. Each Action Item was reviewed by a supervisor to compare the employee’s 
performance against the performance of employees with similar responsibilities and to analyze the 
employee’s actions as a whole. Of that total, 54 Action Items resulted in supervisors initiating corrective 
actions that might otherwise not have been taken. The majority of the corrective measures (38 of the 54) 
resulted in the supervisor determining that the employee would benefit from additional training. The 
remaining 16 Action Items, therefore, are the total number of corrective actions (other than training) that 
resulted from the review of the 1,384 Action Items. 


